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Abstract — The AWGNC, BSC, and max-fractional pseudocode- 
word redundancies of a binary linear code are defined to be the 
smallest number of rows in a parity-check matrix such that the 
corresponding minimum pseudoweight is equal to the minimum 
Hamming distance of the code. It is shown that most codes 
do not have a finite pseudocodeword redundancy. Also, upper 
bounds on the pseudocodeword redundancy for some families 
of codes, including codes based on designs, are provided. The 
pseudocodeword redundancies for all codes of small length (at 
most 9) are computed. Furthermore, comprehensive results are 
provided on the cases of cyclic codes of length at most 250 for 
which the eigenvalue bound of Vontobel and Koetter is sharp. 

Index Terms — LDPC codes; Fundamental cone; Pseudocode- 
words; Pseudoweight; Pseudocodeword redundancy. 



I. Introduction 

PSEUDOCODEWORDS represent the intrinsic mecha- 
nism of failure of binary linear codes under linear- 
programming (LP) or message-passing (MP) decoding (see, 
e.g., [l], |2 |). The concept of pseudoweight of a pseudocode- 
word was introduced in [3| and [4J (see also [2]) as an analog 
to the pertinent parameter in the maximum likelihood (ML) 
decoding scenario, i.e., the signal Euclidean distance in the 
case of the additive white Gaussian noise channel (AWGNC), 
or the Hamming distance in the case of the binary symmetric 
channel (BSC). Accordingly, for a binary linear code C and a 
parity-check matrix H of C, the (AWGNC or BSC) minimum 
pseudoweight Wnii„(i?) may be considered as a first-order 
measure of decoder error-correcting performance for LP or 
MP decoding. Another closely related measure is the max- 
fractional weight, which we sometimes also call pseudoweight 
in order to simplify statements; it serves as a lower bound on 
both AWGNC and BSC pseudoweights. 

In order to minimize the decoding error probability under 
LP (or MP) decoding, one might want to select a matrix H 
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which maximizes the minimum pseudoweight of the code 
for the given channel. Adding redundant rows to the parity- 
check matrix introduces additional constraints on the so-called 
fundamental cone, and thus may improve the performance 
of LP decoding and increase the minimum pseudoweightQ 
However, such additions increase the decoding complexity 
under MP decoding, especially since linear combinations of 
low-density rows may not yield a low-density result. On the 
other hand, there exist classes of codes for which sparse parity- 
check matrices exist with many redundant rows, e.g., f5 |. 

For the AWGNC, BEC (binary erasure channel), BSC, 
and max-fractional pseudoweights, define Pawgnc(C), Pbec(C), 
/Obsc(C), and Pa^^^X^), respectively, to be the minimum num- 
ber of rows in any parity-check matrix H such that the 
minimum pseudoweight of C with respect to this matrix is 
equal to the code's minimum Hamming distance d. For the 
sake of simplicity, we sometimes use the notation p{C) when 
the type of channel is clear from the context. The value 
p{C) is called the (AWGNC, BEC, BSC, or max-fractional) 
pseudocodeword redundancy (or pseudoredundancy) of C. If 
for the code C there exists no such matrix H, we say that the 
pseudoredundancy is infinite. 

The BEC pseudocodeword redundancy, which is equivalent 
to the stopping redundancy, is studied in (|6l, where it is shown 
that for any linear code the BEC pseudoredundancy is finite; 
the paper also contains bounds on /Obec(C) for general binary 
linear codes, and for some specific families of codes. These 
bounds were subsequently improved, for instance in [7|. The 
study of BSC pseudoredundancy was initiated in [8], where 
the authors presented bounds on /5bsc(C) for various families 
of codes. 

In this work, we further investigate pseudoredundancy for 
the AWGNC, BSC, and max-fractional pseudoweight. We 
show that for most codes there exists no H such that the 
minimum pseudoweight (with respect to H) is equal to d, 
and therefore the AWGNC, BSC, and max-fractional pseu- 
docodeword redundancy (as defined above) is infinite for most 
codes. For some code families for which the pseudoredun- 
dancy is finite, we provide upper bounds on its value. We 
consider in particular constructions of new codes from old 
and codes based on designs. Furthermore, we compute the 
pseudocodeword redundancies for all codes of small length 
(at most 9), and we investigate cyclic codes for which the 
eigenvalue bound of Vontobel and Koetter |i9J is sharp. 



We note that for message-passing iterative decoding, apart from the case 
of decoding over the binary erasure channel there is no general statement that 
additional paiity-checks are beneficial. 
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The outline of the paper is as follows. In Section we pro- 
vide detailed definitions and some background information on 
LP decoding, pseudocodewords, the minimum pseudoweight, 
and the pseudocodeword redundancy; we also discuss related 
notions appearing in the literature. Subsequently, we show in 
Section that the pseudocodeword redundancy for random 
codes is infinite with high probability. The next four sections 
are concerned with upper bounds on the pseudoredundancy 
for some particular classes of codes; we investigate punctured 
codes and codes of dimension 2 in Section IIVI constructions 
of codes from other codes in Section |V] parity-check matrices 
of row-weight 2 in Section IVII and codes based on designs 
in Section IVIII The final two sections are devoted to exper- 
imental results; Section IVIIII examines the pseudocodeword 
redundancy for all codes of small length, and Section |IX] 
deals with cyclic codes that meet the eigenvalue bound on the 
minimum AWGNC pseudoweight by Vontobel and Koetter 

n. General Settings 

Let F2 be the binary field and let M be the field of real 
numbers. Addition and multiplication (including matrix- vector 
and matrix-matrix multiplication) are carried out in F2 when 
the operands are defined over F2, and in M when the operands 
are defined over the reals. Occasionally, we will explicitly 
convert elements in F2 into real numbers; in this case we 
identify G F2 with £ M and 1 e F2 with 1 e K. 

Let C be a code of length 71 e N over the binary field F2, 
defined by 

C = kerH = {c G | Hc^ = 0^} 

where is an 771 x n parity-check matrix over F2 of the 
code C. Obviously, the code C may admit more than one parity- 
check matrix, and all the codewords form a linear vector space 
of dimension k> n — ra. We say that k is the dimension of the 
code C. We denote by d{C) (or just d) the minimum Hamming 
distance (also called the minimum distance) of C. The code C 
may then be referred to as an [n, fc, d] linear code over F2. 

Denote the set of column indices and the set of row indices 
of the parity-check matrix H by X = {1, . . . , n} and J = 
{1, . . . ,771}, respectively. For any row index j ^ we let 
2j = {j e I I Hj^i ^ 0} denote the set of the column indices 
where the parity-check matrix is nonzero; similarly for any 
column index j e I we let = {j G J' | iJj ^ 7^ 0} denote 
the corresponding set of row indices. 

The matrix fl is said to be {wc,Wr)- regular if \J'i\ — Wc 
for all i E I and = Wr for all j E J; a. 777)-regular 
matrix is also called simply w-regular. 

A. LP decoding 

We give a brief review of LP decoding. Consider data trans- 
mission over a memoryless binary-input output-symmetric 
channel with channel law PY\x{y\x)- Based on the received 
vector y = (j/i, . . . , 7/„) we can define the log-likelihood-ratio 
vector 7 = (71,..., 7„) G R" by = log(py|x(2/z|0)) - 
log(py|x(j/i|l)) for 7 G I. Viewing the code C canonically as 



a subset of {0, 1}" C M", one can then express ML decoding 
as the minimization problem 

X = arg min (cc, 7} . 
xec 

This is equivalent to the linear programming problem 

X = arg min (a;, 7) , 

a;t^conv(C) 

where conv(C) denotes the convex hull of C in K". However, 
since the number of defining hyperplanes of conv(C) usually 
grows exponentially with the block length, this minimization 
problem becomes impractical. 

Instead one might consider a relaxation of the above mini- 
mization problem (see ifTOl . ifTTI . Q), where the convex hull 
conv(C) is replaced by the so-called fundamental polytope 
■p(-ff) to be defined next. For j G J^, let hj denote the j-th 
row of the parity-check matrix H, and consider the local code 

Cj = {c G F^ I hjc^ = 0} 

consisting of all binary vectors satisfying the j-th parity-check, 
so that C = f]j^jCj. Then the fundamental polytope V ^ 
'P{H) is defined as 

P ^ fl conv(C,) , 

where again Cj is viewed as a subset of R". Now LP decoding 
of a binary linear code C with parity-check matrix H can be 
expressed as the minimization problem 

a; ^ arg min (a;, 7) , (1) 

where V = V{H) denotes the fundamental polytope. 

We note that conv(C) C V, where the inclusion is usually 
proper However, the number of defining hyperplanes of V 
is typically much smaller than for conv(C), in particular for 
LDPC codes, so that the corresponding linear programming 
problem becomes tractable. 

If V is strictly larger than conv(C) then it may happen that 
the decoding rule ^ outputs a vertejJl of V that is not a 
vertex of conv(C), i.e., not a codeword. Such vertices, called 
pseudocodewords, are the reason for the suboptimality of LP 
decoding with respect to ML decoding. 

Note that the fundamental polytope V{H) is dependent on 
the parity-check matrix H rather than the code C itself, but 
we always have r{H) n {0, 1}" = C, cf. lHOl, ifTTl . 

B. The fundamental cone and pseudoweights 

When analyzing LP decoding, we may assume without loss 
of generality that the zero codeword has been sent; then, 
given this assumption, the probability of correct LP decoding 
depends only on the conic hull of the fundamental polytope 
rather than on the fundamental polytope itself (see ifTOl . ifTTl . 
II2I). The conic hull of the fundamental cone 'P{H) is called 

^The set of optimal solutions contains a vertex, and one may assume that 
the output is a vertex. 
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the fundamental cone IC{H). More concretely, JC{H) is given 
as the set of vectors x e M" that satisfy 



(2) 



Vi G X : x,>0. (3) 

The vectors x G 1C{H) are called pseudocodeword^ of C 
with respect to the parity-check matrix H. Note again that 
the fundamental cone IC{H) depends on the parity-check 
matrix H rather than on the code C itself. At the same 
time, the fundamental cone is independent of the underlying 
communication channel. 

Example 2.1: Let C be the [7,4,3] Hamming code with 
parity-check matrix 



H 



Then the fundamental cone inequalities read: 



xi < a;2 + a;3 + X5 

X2 < Xi + X3 + X5 
X3 < Xi + X2 + X5 
X5 < Xi + X2 + X3 



X2 < X3 + X4 + Xe 

X3 < X2 + X4 + Xe 

X4 < X2 + X3 + Xe 

Xe < X2 + X3 + X4 



X3 < X4 + X5 + X7 

X4 < X3 + X5 + X7 

X5 < X3 + X4 + X7 

X7 < X3 + X4 + X5 



0<xi 0<X2 0<X3 0<X4 0<X5 0<xe < X7 

The influence of a nonzero pseudocodeword on the de- 
coding performance will be measured by its pseudoweight, 
which depends on the channel at hand. The BEC, AWGNC, 
BSC pseudoweights, and max-fractional weight of a nonzero 
pseudocodeword x G )C{H) were defined in [4] and 12 as 
follows: 

WBEc(a;) = |supp(a;)| , 



(E 



Let x' be a vector in R" with the same components as x but 
in non-increasing order For i — 1 < ^ < i, where 1 < i < n, 
let 0(0 = x'^. Define $(0 = (t>{C) d^' and 

Wesc(a;) =2$-i($(n)/2) . 
Finally, the max-fractional weight of x is defined as 

/ \ A X/i6l Xi 

w„,„_r™(a;) = ^ . 

Additionally, the pseudoweight of the all-zero vector is 
usually defined to be zero, i.e., w(0) = 0, for all four 
pseudoweights w, but this is inessential for this paper 

Note that for binary vectors x G {0, 1}" \ {0} we have 

Wesc{x) = WMVGNc(a5) = WBsc(a;) = w„,„_r„,(a;) = WH(a;) , 

where WH(a;) denotes the Hamming weight of x. 

Example 2.2: Let C and H be as in Example 12.11 
The vector x — (0,0,1,0,1,1,2) is a pseudocodeword 

^Some authors consider only the vertices of the fundamental polytope 
'P{H) as pseudocodewords, but we will use this more general definition 
which includes all vectors of the fundamental cone K{H). 



in IC{H) with weights WBEc(a^) = |supp(a;)| = 4 and 

WAWGNc(a5) = (Y^iei^^) /SjGi^i = ^^Z"^- Furthermore, 
w^scix) = 2$-i((^,gja:,)/2) = 2$-i(5/2) = 3, 
where x' = (2,1,1,1,0,0,0), and finally, w„,„_r„(a;) = 

J2i^xXi/ maxjexa^i = 5/2. 

We define the BEC minimum pseudoweight of the code C 
with respect to the parity-check matrix H as 



w"""^ (H) 



min Wbec(3') 

xGK{H)\{0} 



The quantities w;X^'^(JJ), w^?„(H) and w™^^"^(if) are de- 
fined similarly. We note that the considered pseudoweights 
are invariant under scaling by a positive scalar, and that a 
minimum is indeed attained on IC{H) \ {0} (see El Sect. 6]). 
When the type of pseudoweight is clear from the context, 
we sometimes use the notation Wi„in(i?). Note that all four 
minimum pseudoweights are upper bounded by d, the code's 
minimum distance. 

C. Pseudocodeword redundancy 

Given a code C we will define the pseudocodeword re- 
dundancy as the minimum number of rows in a parity- 
check matrix H for C such that the corresponding minimum 
pseudoweight equals the minimum distance. 

So for a binary linear [n, k,d] code C we define the BEC 
pseudocodeword redundancy of the code C as 

Pbhc(C) = inf{#rows(ff) | kerJf - C , (if) d} , 

where inf = 00, and similarly we define the pseudocode- 
word redundancies Pawgnc(C), /9bsc(C), and /3„,„_i„,c(C) for the 
AWGNC and BSC pseudoweights, and the max-fractional 
weight. When the type of pseudocodeword redundancy is clear 
from the context, we sometimes use the notation p{C). 

We remark that all pseudocodeword redundancies satisfy 
p{C) > r — n ~ k. 

Example 2.3: Let C be the [7, 4, 3] Hamming code. Then: 

/0„,ax-rmc(C) = 7 > /9aWGNc(C) = 3 > PbEc(C) 3 

P™.-r„(C) = 7 > Pbsc(C) = 4 > Pbec(C) = 3 

The following matrices H3, H4, and iJy are examples for 
parity-check matrices with a minimum number of rows such 

3, and 



that wf-„ (JJ3) = w» 
^-^TiHi) = 3 holds. 



3, <UHi 
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These matrices were found by computer search, see Sec- 
tion |VlII] 

We describe the behavior of the pseudocodeword redun- 
dancy and the minimum pseudoweight for a given binary Hnear 
[n, k, d] code C by introducing four classes of codes: 

(class 0) p{C) is infinite, i.e., there is no parity-check 

matrix H with d — w,„i„(ff), 
(class 1) p{C) is finite, but p{C) > r, 
(class 2) p{C) = r, but C is not in class 3, 
(class 3) d = w,„i„(J?) for every parity-check matrix H 

of C. 

Note that if a code has infinite pseudocodeword redundancy, 
then LP decoding for this code can never achieve the ML 
decoding performance; on the other hand, if a code's pseu- 
docodeword redundancy is finite, its value gives a (very ap- 
proximate) indication of the LP decoding complexity required 
to achieve this bound. Note that this is a fundamental com- 
plexity associated with the code, and not tied to a particular 
parity-check matrix. We leave it as a direction for further 
research to provide more general definitions which capture 
the average complexity-performance tradeoff of LP decoding 
as more redundant rows are added to the parity-check matrix. 

D. Basic Connections 

The different minimum pseudoweights are related as fol- 
lows. This result is taken from [2|. 

Lemma 2.4: Let C be a binary linear code with the parity- 
check matrix H. Then, 



min 

,mux-frau 



{H) < K^^iH) < (if) 



max-frac/JJN BSC /JJX < BEC /JJN 

As a straightforward corollary we obtain the following 
theorem, which relates the different pseudoredundancies. 
Theorem 2.5: Let C be a binary linear code. Then, 

P,™-r™(C) > Pawgnc(C) > Pbec(C) , 

P„,»-fn,c(C) > PbSc(C) > PbEc(C) . 

E. Related Notions 

As mentioned in the introduction, Schwartz and Vardy 
consider in f6l the so-called stopping distance of a binary 
linear code given by a parity-check matrix, and the stopping 
redundancy of a binary linear code. With (|2] Proposition 51] 
it is easy to see that the stopping distance equals the minimum 
BEC pseudoweight, and thus the stopping redundancy is 
equivalent to the BEC pseudocodeword redundancy. 

Besides pseudocodewords, the notion of trapping set lfT2ll is 
another concept for analyzing the performance of binary linear 
codes under MP decoding. In ifTsll the trapping redundancy 
for binary linear codes is introduced as a generalization of the 
stopping redundancy, and several upper bounds are presented. 

In lfT4l a binary linear code C is called geometrically perfect 
if it admits a parity-check matrix H such that the fundamental 
polytope equals the convex hull of the code, i.e., 'P{H) = 
conv(C). In this case ML decoding can be exactly described as 
an instance of LP decoding. Kashyap fT4l Theorem VI. 2] gave 



a characterization of all geometrically perfect codes: a binary 
linear code C is geometrically perfect if and only if C does 
not contain as a minoi0 any code equivalent to certain codes 
Ci, C2, C3 with parameters [7,3,4], [10,5,4], and [10,4,4], 
respectively. 

It is easy to see that for geometrically perfect codes all four 
pseudocodeword redundancies are finite. 

Smarandache and Vontobel [15 | define the pseudoweight 
spectrum gap for a binary linear code C given by a parity- 
check matrix H as follows. The set AA{H) of all minimal 
pseudocodewords is defined as the set of all vectors x G M" 
that lie on an edge of the fundamental cone JC{H). Now let 
A4'{H) denote the set of all minimal pseudocodewords that 
are not scalar multiples of codewords c G C, and let w be any 
of the BEC, AWGNC, BSC, or max-fractional pseudoweight. 
Then the pseudoweight spectrum gap is the quantity 

giH)= min \n{x) - d{C) . 

xeM'{H) 

It is apparent that g{H) > Wniin(-ff) ^ d{C), and we have 
Wmin(if) = d{C) if and only if g{H) > 0. 

If the pseudoweight spectrum gap g{H) is strictly positive 
then the LP decoding performance approaches ML decoding 
performance as the signal-to-noise ratio goes to infinity. To 
date, only few examples of interesting codes with positive 
pseudoweight spectrum gap are known; these include the codes 
based on the Euclidean plane or the projective plane ifTS] 
Theorem 8]. 

III. PSEUDOREDUNDANCY OF RANDOM CODES 

In this section we show that for most binary linear codes the 
AWGNC and BSC pseudoredundancies are infinite. We begin 
with the following lemma. 

Lemma 3.1: For a binary linear code C of length n, let d^ 
be the minimum distance of the dual code. Then, the minimum 
AWGNC pseudoweight of C (with respect to any parity-check 
matrix H) satisfies 

(n + d-L -2)2 



W AWGNC ^ 
mm 



(4) 



{d^ - 1)2 + (n - 1) ■ 

Proof: Consider the pseudocodeword x = 
{xi,X2, ■ . ■ ,Xn) = (d-'- — 1 , 1 , . . . , 1). Since d^ is the 
minimum distance of the dual code, every row in H has 
weight at least d^. Therefore, all inequalities (|2} and (|3]l are 
satisfied for this x, and so it is indeed a legal pseudocodeword. 
Finally, observe that the AWGNC pseudoweight of x is given 
by the right-hand side of (|4]l. ■ 
In the sequel, we use the term random code for a binary 
linear code C whose k xn generator matrix contains indepen- 
dently and uniformly distributed random entries from F2. The 
following result is known as the Gilbert- Varshamov bound. If 
we pick a code by selecting the generator matrix entries at 
random, the resulting code C has rate R = k/n and relative 
minimum distance S, such that 



6 > H^\l 



R) 



''a minor of a code C is any code obtained from C by a (possibly empty) 
sequence of shortening and puncturing operations. 
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with probability approaching 1 as n — )■ oo, for any fixed small 
e > 0, where H^^(-) is the inverse of the binary entropy 
function H2(p) — —p\og2P — (1 — p)log2(l — p) for p G 
[0 , 1/2] . A similar result also holds when the code C is defined 
by selecting the parity-check matrix entries (independently and 
uniformly) at random. 

Let R — k/n he fixed. Then, if we select at random a 
k X n matrix over F2, which corresponds to a code C, the 
relative minimum distance of C is at least H2"^(l — R) — e 
(with probability approaching 1 as 71 ^> 00) and the relative 
minimum distance of the dual code of C is at least H^^ (i?) — e 
(again, with probability approaching 1 as n — >■ 00). By taking 
the intersection of these two events, both the code and the dual 
code have relative minimum distances which are e-close to the 
Gilbert- Varshamov bound with probability approaching 1 as 
n — > cxD. (The reader can refer to lfT6] Theorems 4.4, 4.5, and 
4.10] and to fTT, Theorem 8 and Exercise 3].) 

To this end, we take a random binary linear code C of 
arbitrary length n (for n — > cxd) with R^ k/n. The dual code 
of C, with probability close to one, has rate R^ = 1 — R 
and relative minimum distance 5^ — d^/n that attains the 
Gilbert- Varshamov bound 



> 



^U^\l-R^)-e=\\^\R)-e, 



Note that ^ may be written in terms of the relative 
minimum distance 6^ of the dual code as follows: 

.wcNc < (l + J-L-2/n)^ 

™ - ((5-L-l/n)2 + (l/n-l/n2) ■ ^ ' 

Hence, for large n, the minimum pseudoweight of the code C 
is bounded from above by (1 + 1/(5^)^ + e' < (l + l//i)2 + e' 
for some small e' > 0, and this bound does not depend on n. 
On the other hand, C is a random code and so its minimum 
distance satisfies the Gilbert- Varshamov bound, namely 

d> (H-i(l-i?)-e) - n, 

which increases linearly with n for a fixed R. This immedi- 
ately establishes the following theorem. 

Theorem 3.2: Let < i? < 1 be fixed. For a random 
binary linear code C of length n and rate R, there is, with 
probability approaching 1 as n tends to infinity, a gap between 
the minimum AWGNC pseudoweight (with respect to any 
parity-check matrix) and the minimum distance. Therefore, 
the AWGNC pseudoredundancy is infinite for most codes. 

Remark 3.3: The result in Theorem 13.21 is different from, 
but related to, the results in Propositions 49 and Corollary 50 
in ||2l, where it was shown that the minimum AWGN pseu- 
doweight of ensembles of regular LDPC codes grows sublin- 
early in the code length. Indeed, there are three fundamental 
differences between our results and [2 |: (i) We do not assume 
anything about the density of the parity-check matrix H. We 
also use the fact that the dual code of the random code is 
asymptotically good; for a regular LDPC code this is not true, 
(ii) We consider the fundamental cone, which is formed by all 
possible linear combinations of the rows of H; by contrast, 
the authors of [2 | consider only the case when the column 
weight of H is smaller than its row weight, (iii) We show 
that the minimum pseudoweight of the considered ensemble 



is bounded from above by a constant, while in [T) this quantity 
is shown to be bounded by a sublinear function. 

The following lemma is a counterpart of Lemma ITT] for the 
BSC. 

Lemma 3.4: Let C be a binary linear code of length n, and 
let be the minimum distance of the dual code. Then, the 
minimum BSC pseudoweight of C (with respect to any parity- 
check matrix H) satisfies 

w:Sn<'2\n/d^^ . 



Proof: Consider the pseudocodeword 



id' 



-1, 



-1, 1, 



for some positive integer t. This vector x is then a legal 
pseudocodeword; since d^ is the minimum distance of the 
dual code, every row in H has a weight of at least d^, and 
so, all inequalities Q and OJ are satisfied by this x. 

If T{d-'- - 1) > n - T then by the definition of the BSC 
pseudoweight Wbsc{x) < It. This condition is equivalent 
to rrf^ > 71. Therefore, we set t = [71/ d^]. For the 
corresponding vector x, the pseudoweight is less or equal to 
2T^2\nld^\ ■ 

Similarly to the AWGNC case, let C be a random binary 
linear code of length n with R — k/n. The parameters R^ 
and 5^ of its dual code attain with high probability the 
Gilbert- Varshamov bound 5^ > fx. 

From Lemma U4] for all n, the pseudoweight of the code C 
is bounded from above by 

2\n/d^^ < 2/6^ + 2 < 2//i + 2 , 

which is a constant. On the other hand, C is a random 
code and its minimum distance also satisfies the Gilbert- 
Varshamov bound, so it increases linearly with n. This proves 
the following theorem. 

Theorem 3.5: Let < i? < 1 be fixed. For a random 
binary linear code C of length n and rate R, there is, with 
probability approaching 1 as tt, tends to infinity, a gap between 
the minimum BSC pseudoweight (with respect to any parity- 
check matrix) and the minimum distance. Therefore, the BSC 
pseudoredundancy is infinite for most codes. 

The last theorem disproves the conjecture in |[8] that the 
BSC pseudoredundancy is finite for all binary linear codesjl 

Example 3.6: Consider the [23,12] Golay code having min- 
imum distance d ~ 7. The minimum distance of its dual 
code is d^ = 8. We can take a pseudocodeword x as in 
the proof of Lemma 13.41 with r = \n/d-^] — 3. We have 
Wbsc(3^) < 2r = 6, thus obtaining that the minimum distance 
is not equal to the minimum pseudoweight. 

Similarly, for the [24,12] extended Golay code we have d ~ 
d^ = 8, and by taking r — \n/d-^^ = 3 we obtain Wesclaj) < 
2t = 6. 

Note however that the presented techniques do not answer 
the question of whether these Golay codes have finite AWGNC 
pseudoredundancy. 

^We note that a slightly different defin ition of BSC pseud owei ght was given 
in 1 8 1, but the statement of Lemma [3!4l and thus Theorem 13.51 hold with the 
same proof also with respect to this definition. 
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In the context of the extended Golay code we mention that 
there other interesting graphical representations of codes than 
by Tanner graphs; in particular, a minimal tail-biting trellis 
has been constructed for the extended Golay code in ifTSI . The 
pseudoweights of its pseudocodewords are investigated in (4], 
where it is shown that there are pseudocodewords with a BSC 
pseudoweight of 6; on the other hand, as far as we know, it 
is still unknown whether there are nonzero pseudocodewords 
of the tail-biting trellis with an AWGNC pseudoweight of less 
than 8. 

We have seen in this section that the AWGNC pseudore- 
dundancy and the BSC pseudoredundancy of a random binary 
Unear code is infinite. From Theorem 12.5 1 it follows that this 
holds also for the pseudoredundancy with respect to the max- 
fractional weight. 

IV. Basic Upper Bounds 

Whereas a random code has infinite pseudoredundancy for 
the AWGNC and the BSC, there are several families of codes 
for which the pseudoredundancy is finite. Sections |IV] |V] |VI] 
and IVIII deal with upper bounds on the pseudoredunancy for 
some particular classes of codes. 

We start with this section considering two basic situations, 
namely the puncturing of zero coordinates and codes of 
minimum distance 2. The following results hold with respect 
to the BEC, AWGNC, and BSC pseudoweights, and the max- 
fractional weight. 

Lemma 4.1: Let C be an [n, fc,(i] code having t zero co- 
ordinates, and let C be the [n ~ t, k, d] code obtained by 
puncturing C at these coordinates. Then 

piC')<p{C)<piC') + t. 

Proof: For notational purposes, we identify M" with R^, 
and for x E R-^ and some subset I' C I we let a;|x' G M"^ 
be the projection of x onto the coordinates in I'. 

Let I' C I be the set of nonzero coordinates of the code C. 
To prove the first inequality, let iJ be a p x n parity-check 
matrix for C. Consider its px [n — t) submatrix H' consisting 
of the columns corresponding to I' . Then H' is a parity-check 
matrix for C, and 

JC{H') = {x\x, I X e IC{H), x\x\x, = 0} . 

Therefore, w^in{H') > Wmin(-H'), and this proves p{C') < 
piC). 

For the second inequality, let H' he a p' x [n — t) parity- 
check matrix for C . Now we consider a [p' + 1) x n matrix 
H with the following properties: The upper p' x n submatrix 
of H consists of the columns of H' at positions I' and of 
zero-columns at positions X\I' , and the lower txn submatrix 
consists of rows of weight 1 that have Is at the positions X\I' . 
Then C = ker H and 

K:{H) = {a; G I x\i, £ 1C{H'), x\x\i> = 0} . 

Consequently, Wniin(if) = Wj-nin{H'), and this proves p{C) < 

p{C')+t. m 

Lemma 4.2: Let C be a code of minimum distance d < 2. 
Then d — w^in{H) for any parity-check matrix H of C, i.e.. 



C is in class 3 (for BEC, AWGNC, BSC, and max-fractional 
pseudoweight). 

Proof: By Lemma 12.41 it suffices to prove this lemma 
for the max-fractional weight w = w„,xrnic- Since w(a;) > 1 
holds for all nonzero pseudocodewords, we always have 
Wniin(-f^) > 1, which proves the result in the case d = 1. 

Let d = 2 and H he a parity-check matrix for C. Let x G 
JC{H) and let xi he the largest coordinate. Since d— 2 there 
is no zero column in H and thus there exists a row j with 
£ G Ij. Then xg < J2iei\{e} hence 2xg < J2iex^i' ^^'^ 
thus w{x) > 2. It follows Wmin(Jf) > 2 and the lemma is 
proved. ■ 

V. Constructions of codes from other codes 

The following results consider the pseudoredundancy of 
codes obtained from other codes by the direct sum or the {u u) 
construction. They are analogs of Theorems 7 and 8 in fSl, 
and Theorems 4.1 and 4.2 in |8|, for the case of the max- 
fractional weight and the AWGNC pseudoweight. Our proofs 
in each case follow the exposition of these earlier proofs. 

Theorem 5.L- Let Ci and C2 be [rii, ki, di] and [712, fc2, '^2] 
binary linear codes, respectively. Then the direct sum C3 — 
{{u v) \ u e Ci,v e C2} is an [ni +7^2, fci + fc2, min{di, ^2}] 
code with 

P„,»-fmc(C3) < p„,„-rm.(Ci) + p„„-r™(C2) , 
PAWGNC (C3)< PAWGNC (Ci) + Pawgnc 

Proof: Without loss of generality, we may assume that 
both p{Ci) and ^(6*2) are finite, for otherwise the statement 
to be proved is trivial. For i — 1,2, let Hi he a parity-check 
matrix for Ci having p{Ci) rows and such that w(a;) > di for 
all X G IC{Hi) \ {0}. Then 

" Hi 
H2 

is a parity-check matrix for C3 with p{Ci) + p(C2) rows. Let 
p = {q r) E JC{H^) \ {0}, where the vectors q and r in the 
concatenation have lengths ni and 772 respectively. Then, we 
may assume q G lC{Hi) \ {0} and r G /C(i?2) \ {0}, and 
therefore w(q) > di and w(r) > d2. (Note that in the case 
where either q or r is equal to 0, the result is trivial since 
for any q 0, w{q 0) — vj{q) for both the max-fractional 
weight and the AWGNC pseudoweight.) 

We consider the two cases of max-fractional weight and 
AWGNC pseudoweight separately. 

Max-fractional weight: Assume without loss of generality 
that max{(7i} > max{ri}. Then 



H 



3 — 



w„,„_f„(p) 



max{pi} max{gi} 



> 



> di > min{di,(i2} 



max{(7j 

which proves the result. 

AWGNC pseudoweight: Assume without loss of generality 
that WawgncI?) > WawgncIj"); this condition may be written as 

(ni \2,n2 \ / rii \ / "2 \ 2 
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To establish the resuh, we need only to prove that Wawgnc(p) > 
Wawgnc(^)- Now, since the entries of q and r are nonnegative, 
we have 

Adding ( ^0 ^ ( Er=i to both sides of O and adding 
the resulting inequality to inequality (|6]l yields 

(rii ri2 \2 / "2 \ / "2 \2 / "1 "2 \ 

i=l 1=1 ^ ^ 1=1 ^ ^ i=l ' ^ i=l i=l ' 

which may be rearranged as Wawgnc(p) > (r), as 

desired. ■ 
Theorem 5.2: Let Ci be an [n, k, d] binary linear code. Then 
C2 — {{u u) \ u G Ci} is a [2n, k, 2d] code with 

/3max-rn,c(C2) < P„,„-r™c (Cl ) + U , 
PAWGNC (C2)< Pawgnc 

(Ci) + n . 

Proof: As before, without loss of generality, we may 
assume that p{Ci) is finite. Let Hi be a parity-check matrix 
for Ci with p{Ci) rows and such that w(a;) > di for all 
X G /C(i?i) \{0}. Then 

is a parity-check matrix for C2 with p(Ci) + n rows (here 
/„ denotes the n x n identity matrix). Let p = (g r) e 
/C(i?2) \ {0}, where the vectors q e IC{Hi) and r in the 
concatenation both have length n. Then, for i = 1,2, ... ,n, 
from the fundamental cone inequalities for row n + i we get 
qi ^ Ti < Qi, SO we have p = {q q). Now, since q G /C(i?i)\ 
{0}, we have w(q) > di. Since w((q q)) = 2w(q) for both 
the max-fractional weight and the AWGNC pseudoweight, we 
have w(p) > 2d, and the result follows. ■ 
Remark 5.3: Theorem 9 in ID and Theorem 4.3 in [8 1 state 
that if C is an [n, k, 3] binary linear code then the extended 
[n+1, k, 4] code C satisfies p{C') < 2p{C), for the BBC pseu- 
doweight and the BSC pseudoweight, respectively. Regarding 
the corresponding results for the case of the max-fractional 
weight and the AWGNC pseudoweight, we mention here only 
that the analogous result in fact does not hold for the case of 
the max-fractional weight. As a counterexample, consider the 
[7, 4, 3] Hamming code Ci which satisfies p{Ci) <2^ — 1 = 7 
(cf. Proposition 17. 7t . On the other hand, the [8,4,4] extended 
Hamming code C2 satisfies p„„_rn,c(C2) — 00 (cf. Section 
IVIII-BI ). 

VI. Parity-check matrices with rows of weight 2 

In this section we consider the pseudoredundancy of codes 
with a parity-check matrix consisting of rows of weight 2 and 
at most one additional row. The results are then applied to 
upper-bound the pseudoredundancy for codes of dimension 2. 
The basic case is dealt with in the following lemma. 

Lemma 6.1: Let be a parity-check matrix of C such that 
every row in H has weight 2. Then: 



(a) There is an equivalence relation on the set I of column 
indices of H such that for a vector x G M" with non- 
negative coordinates we have x G IC{H) if and only if 
X has equal coordinates within each equivalence class. 

(b) The minimum distance of C is equal to its minimum 
BBC, AWGNC, BSC, and max-fractional pseudoweights 
with respect to H, i.e., d{C) — Winin(-ff). 

Proof: For (a), define the required relation R as follows: 
For z, z' G X let {i, i') G i? if and only \f i — i' or there exists 
an integer i > 1, column indices i = iQ,ii, . . . , ii-i,i£ = z' G 
I and row indices ji, ■ . . , ji G J such that 

, {11,12} ^X,^ , ... , =Ij, . 

This is an equivalence relation, and it defines equivalence 
classes over I. It is easy to check that inequalities ^ imply 
that X G IC{H) if and only if xi = Xii for any {i, i') G B. 

In order to prove (b), we note that the minimum (BBC, 
AWGNC, BSC or max-fractional) pseudoweight is always 
bounded above by the minimum distance of C, so we only have 
to show that the minimum pseudoweight is bounded below by 
the minimum distance. 

Let S — {Si, S2, ■ ■ ■ , St} be the set of equivalence classes 
of R, and let ^5 = \S\ for G 5. It is easy to see that 
the minimum distance of C is c? = min5£5d5 (since the 
minimum weight nonzero codeword of C has non-zeros in the 
coordinates corresponding to a set S" G 5 of minimal size and 
zeros everywhere else). 

Now let X G 1C{H). Since the coordinates Xi, i El, depend 
only on the equivalence classes, we may use the notation xs, 
S G S. Let XT, T E S, he the largest coordinate. Then: 

w„„„,„,(a;) = ^lei^ > ^ \T\ ^ dr > d . 

XT XT 

Therefore, w^;^'°'(ff) > d, and by using Lemma 1241 we get 
w-J„(i?) > d, w™r(Jf) > d, and wf-„(/f) >d. m 
The following proposition is a stronger version of 
Lemma 16.11 

Proposition 6.2: Let iJ be an m x n parity-check matrix 
of C, and assume that the m — 1 first rows in H have 
weight 2. Denote by H the (to — 1) x n matrix consisting 
of these rows, consider the equivalence relation of Lemma 16. II 
(a) with respect to H, and assume that intersects each 
equivalence class in at most one element. Then, the minimum 
distance of C is equal to its minimum BBC, AWGNC, BSC, 
and max-fractional pseudoweights with respect to H, i.e.. 

Proof: Let S be the set of classes of the aforementioned 
equivalence relation on I, and let ^5 = jS"! for S E S. Let 

s'^{SeS\ \sni^\^i}. 

Also let S" =S\ S', so that 5 n I„ = for all S E S". 

Let X E IC{H) \ {0}. As before, since the coordinates Xi, 
i E X, depend only on the equivalence classes, we may use 
the notation xs, S E S. The fundamental cone constraints (|2|i 
and ([3]) may then be written as > for all 5 G 5 and 

'iRES': XR< J2 ^s, (8) 

seS'\{R} 
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respectively, and the max-fractional weight of a; G IC{H)\{0} 
is given by 



w„. 



max5g5 xs 



(9) 



Suppose X G \ {0} has minimal max-fractional 

weight. Let xt be its largest coordinate. First note that if 
there exists i? G 5" \ {T} with xr > 0, setting xr to zero 
results in a new pseudocodeword with lower max-fractional 
weight, which contradicts the assumption that x achieves the 
minimum. Therefore xr — for all R E S" \ {T}. We next 
consider two cases. 

Case 1: T G S". If there exists R G S' with xr > 0, setting 
all such Xr to zero results in a new pseudocodeword with 
lower max-fractional weight, which contradicts the minimality 
of the max-fractional weight of x. Therefore xt is the only 
positive coordinate of x, and by ^ the max-fractional weight 
of X is dT- 

Case 2: T G 5'. In this case xr — for all R G S" . From 
inequality (O for R — T we obtain 



Xt < 



seS'\{T} 



With do ~ miiis^gi\[T} ds it follows that 

doXT < ^ doxs < ^ dsxs ■ 
seS'\{T} seS'\{T} 



Consequently, 



{(It + do)xT < ^ dsXs 



and thus w„,„_r„(a;) > dT + do. We conclude that the minimum 
max-fractional weight is given by 



min \ds 



dT} , mm{ds} 



But this is easily seen to be equal to the minimum distance d 
of the code. 

Finally, by using Lemma |2~4l we obtain that w^'[^{H) = d, 



w-r (-ff) - d and ^^ZniH) = d. 



Remark 6.3: The requirement that all i G belong 
to different equivalence classes of H in Proposition 16.21 is 
necessary. Indeed, consider the matrix 



H 



110 
110 
10 10 

1111 



One can see that there are two equivalence classes for H: 
Si = {1,2,3}, 52 = {4}. The minimum distance of the 
corresponding code C is 4 (since (1,1,1,1) is the only 
nonzero codeword). However, x = (1,1,1,3) G IC{H) is a 
pseudocodeword of max-fractional weight 2. 

Corollary 6.4: Let C be a code of length n and dimension 2. 
Then p(C) = n — 2, i.e., C is of class at least 2 (for BEC, 
AWGNC, BSC, and max-fractional pseudoweight). 



Proof: We consider two cases. 
Case 1: C has no zero coordinates. 

Let Ci and C2 be two linearly independent codewords of C. 
Define the following subsets of I: 

Si = {i G X I i G supp(ci) and i ^ supp(c2)} 
^2 = {i eI \ i ^ supp(ci) and i G supp(c2)} 
53 = {i G I I i G supp(ci) and i G supp(c2)}. 

The sets Si, S2, and 53 are pairwise disjoint. Since C has 
no zero coordinates, I — 5i U 52 U 53. The ordering of the 
elements in I implies an ordering on the elements in each 
of Si, S2, and 53. Assume that Si — {11,12,- •• ,i[Si|} and 
ii < 12 < ■ ■ ■ < *|Si|- If "5*1 7^ <ZS, let mi — ii be the minimal 
element in 5i, and define an (|5i| — l)xnmatrix i?i = (Hj^) 
as follows: 



1 if ii — £ OT i 



J 

otherwise 



1,2, 



1^1 1 



Similarly, define (|52| — 1) x n and (|53| — 1) x n matrices 
H2 and i?3, with respect to 52 and 53. (Some of the 5iS 
might be equal to 0, in which case the corresponding Hi is 
not defined.) Let 7712 and ma be minimal elements of 52 and 
53, respectively (if 52 7^ and 53 ^ 0). 

Subcase 1-a: One of Si, S2, S3 is empty. Without loss of 
generality we may assume that 53 = 0, i.e., that ci and C2 
have disjoint support; indeed, if for example 5i = 0, then 
supp(ci) C supp(c2) and we can replace C2 by C1+C2. Define 
an (n — 2) X n matrix H by = [fff | -ffi"]- ^^^Y 
to see that all rows of H are linearly independent, and so its 
rank is n — 2. It is also straightforward that for all c G C 
we have c G kci{H). Therefore, if is a parity-check matrix 
of C. The matrix H has a form as in Lemma 16.11 and thus 
p{C) = n-2. 

Subcase 1-b: Neither of Si, S2, S3 is empty. Define a 1 x n 
matrix = (Hj^), where 



1 if Sj ^ and nij 



Hi^e - 



fori = 1,2,3, 



otherwise 



Additionally, define an 



2) X n matrix H by H 



T A 



[i?! I H2 I I ]. Similarly to the previous case, all 
rows of H are linearly independent, its rank is ?i — 2. For all 
c G C we have c G kcr(ff). Therefore, H is a parity-check 
matrix of C. 

The matrix H has a form as in Proposition 16.21 (where 5i, 
52, and 53 are corresponding equivalence classes over T), and 
therefore p{C) = n — 2. 

Case 2: C has t > zero coordinates. 

Consider a code C of length n~t obtained by puncturing C 
in these t zero coordinates. From Case 1 (with respect to C), 
p{C') = n — t — 2. By applying the rightmost inequality in 
Lemma l4n we have p{C) < n — 2. Since fc = 2, we conclude 
that p{C) =n-2. ■ 
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VII. Codes Based on Designs 

Among the codes with finite pseudoredundancy an inter- 
esting class of codes is based on designs. In this section we 
consider partial designs, which include the common BIBDs 
(also called 2-designs). We present a principal lower bound on 
the minimum pseudoweight for codes, when the parity-check 
matrix is the block-point incidence matrix of a partial design. 
We apply this bound to the Hamming codes and the simplex 
codes and deduce that their pseudoredundancy is finite. 

Definition 7.1: A partial (i/7c,A) design is a block design 
consisting of an n-element set V (whose elements are called 
points) and a collection of m subsets of V (called blocks) such 
that every point is contained in exactly Wc blocks and every 
2-element subset of V is contained in at most A blocks. The 
incidence matrix of a design is an m x n matrix H whose 
rows correspond to the blocks and whose columns correspond 
to the points, and that satisfies Hj i = 1 if block j contains 
point i, and Hj i — otherwise. 

If each block contains the same number Wr of points and 
every 2-element subset of V is contained in exactly A blocks, 
the design is said to be an (n, z/;r,A) balanced incomplete 
block design (BIBD), or 2-design. 

In the following we avoid the trivial cases n < 1 and A = 0. 
For a BIBD we have nwc = mwr and also 

Wc {Wr — 1) = A (n — 1) 

(see, e.g., |19i p. 60]), so (?i,w,.,A) determines the other 
parameters Wc and m by 

n — 1 , , n (n — 1) 



A and 



■A, 



(10) 



Wr — 1 Wr {Wr — 1) 

Note that |'20l and 1*21] consider parity-check matrices based 
on BIBDs; these matrices are the transpose of the incidence 
matrices defined here. 

We have the following general result for codes based on 
partial (wc,A) designs. 

Theorem 7.2: Let C be a code with parity-check matrix H, 
such that a subset of the rows of H forms the incidence matrix 
for a partial (wc, A) design. Then the minimum max-fractional 
weight of C with respect to H is lower bounded by 

w™r>i + ^- (11) 

For the case of an (n, Wr, A) BIBD, the lower bound in (fTTT i 
may also be written as 



max-frac > ^ 

""min — ^ 



1 



Wr — 1 



the alternative form follows directly from dTHi . 

Proof: Consider the subset of the rows of H which forms 
the incidence matrix for a partial {wc , A) design. Let x be a 
nonzero pseudocodeword and let xg be a maximal coordinate 
of a; (£ G T). For all j G J'i, sum inequalities (|2]i. We have 



WcXi < A 



and thus 



(12) 



The result now easily follows from the definition of w^jj!^"". ■ 
Theorem 7.3: Let C be a code with parity-check matrix H, 
such that a subset of the rows of H forms the incidence matrix 
for a partial {wc, A) design. Then, 

7/1 

AWGNC \ 1 I 

w„i„ > i + — , 



W"'^- > 1 



A ■ 

Proof: Apply Lemma |Z41 and Theorem 17.21 ■ 

Results similar to Theorem 17.21 and Theorem 17 . 3 1 were also 
presented and proven by Xia and Fu [22] in the AWGNC case. 

Remark 7.4: Under the conditions of Theorem 17.31 if a; G 
IC{H) is a nonzero pseudocodeword such that WAwoNc(ic) = 
1 + ^ holds then it follows that a; is a scalar multiple of a 
binary vector This can be easily seen by considering the proof 
of the inequality WAWGNc(ic) > w„„_irac(ic) (see [2., Lemma 44]) 
and examining when equality WAWGNc(aj) ~ w„,„_r„.(a;) holds. 

Furthermore it can be shown that in this case x is actually a 
scalar multiple of a codeword (see ll22l Theorem 3]). It follows 
that the AWGNC pseudocodeword spectrum gap is positive, 
provided that d{C) ^ 1 + ^ holds. 

Another tool for proving lower bounds on the mini- 
mum AWGNC pseudoweight is provided by the following 
eigenvalue-based lower bound by Vontobel and Koetter |.9J . 

Proposition 7.5 (cf. [9J): The minimum AWGNC pseu- 
doweight for a {wc, u'r)-regular parity-check matrix H whose 
corresponding Tanner graph is connected is bounded below by 



w 



> n ■ 



H^H. 



Ml - ^2 

where pi and p2 denote the largest and second largest eigen- 
value (respectively) of the matrix L = H^H; here, L and 
the matrix multiplication are to be considered over the reals. 

In the case where H is equal to the incidence matrix for 
an {n,Wr, A) BIBD, the bound of Proposition 17.51 becomes 

111 

„,AWGNC ^ 1 , 

W^in > 1 + — , (14) 

so that in this case the bound of Proposition 17.51 coincides with 
that of Theorem ITJ] (for the case of the AWGNC only). 

To see why ( fT3T l becomes (fl4l i. denote the column i G I 
of H by hi and denote the matrix L — {Li.i)^ 
From the properties of a BIBD we get 



Now, L has largest eigenvalue pi — WrWc and only one other 
eigenvalue p2 — Wc ~ X, whose multiplicity is n — 1, since 
one can write L = X1 + {wc — A)/, where 1 and I denote the 
all-ones and the identity matrices, respectively. Now we have 

2wc — /i2 = + A and pi — P2 — WrWc — Wc + X = nX, so 
that n ■ 22£c^ = 1 + 

Remark 7.6: Prominent examples for codes based on de- 
signs are codes based on Euclidean or projective ge- 
ometries, in particular the [4^* — 1 , 4'' — S'' , 2'' + 1] code 
based on the Euclidean plane EG(2,2'') as well as the 
[4" + 2" + 1 , 4^* - 3" + 2% 2" + 2] code based on the pro- 
jective plane PG(2, 2") (see Q, (Bl). Theorem |73] and 
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Remark 17.41 apply to these codes, as their standard parity- 
check matrices form the incidence matrix for a partial design 
with parameters {wc, A) = (2^ 1) and {wc, A) = (2" + 1 , 1), 
respectivel}^; in particular these codes have finite pseudore- 
dundancy. 

We next apply the bounds of Theorems 17.21 and 17 . 3 1 to some 
other examples of codes derived from designs. 

Proposition 7.7: For m > 2, the [2™ - 1 , 2" - 1 - to , 3] 
Hamming code has BEC, AWGNC, BSC, and max-fractional 
pseudocodeword redundancies 



p{C) < T 



1 



Proof: For to > 2, consider the binary parity-check 
matrix H whose rows are exactly the nonzero codewords 
of the dual code C^, in this case the [2™ - 1 , to , 2""^ ] 
simplex code. This H is the incidence matrix for a BIBD with 
parameters (n, Wr, A) = (2™ - 1 , 2™-i , 2"'^^). Theorem 1X2] 
gives w„„_f„,(a;) > 3, leading to /9,„„4n,c(C) < 2™ - 1. 

The result for BEC, AWGNC, and BSC follows by applying 
Theorem 12.51 ■ 

In the next example, we consider simplex codes. Straight- 
forward application of the previous reasoning does not lead 
to the desired result. However, more careful selection of the 
matrix H, as described below, leads to a new bound on the 
pseudoredundancy. 

Proposition 7.8: For to > 2, the [2™ — 1 , m , 2™^^] sim- 
plex code has BEC, AWGNC, BSC, and max-fractional pseu- 
docodeword redundancies 



(2™ _ 1) (2'^ 



-1 



p{C) < 

Proof: For m > 2, consider the binary parity-check 
matrix H whose rows are exactly the codewords of the dual 
code C-^ (in this case the [2™ — 1 , 2™ — 1 — to , 3] Hamming 
code) with Hamming weight equal to 3. This H is the 
incidence matrix for a BIBD with parameters {n,Wr,X) = 
(2™ -1,3,1). Theorem Ogives w™/™ > 2"-i. 

Note that the number of codewords of weight 3 
in the [2™ — 1 , 2™ — 1 — m , 3] Hamming code equals 
(2™ — 1)(2™^^ — l)/3. One can show this, e.g., by consider- 
ing the full sphere-packing of the perfect Hamming code and 
observing that each codeword of weight 3 covers exactly 3 
vectors of weight 2, of which there are (2™ - 1)(2™ - 2)/2 
in total. 

Next, we justify the claim that iif is a parity-check matrix 
of C. A theorem of Simonis f23l states that if there exists a 
linear [n,k,d] code then there also exists a linear [n,k,d] 
code whose codewords are spanned by the codewords of 
weight d. Since the Hamming code is unique for the parame- 
ters [2™ — 1 , 2™ — 1 — m , 3], this implies that the Hamming 
code itself is spanned by the codewords of weight 3, so the 
rowspace of H equals C. 

The result for BEC, AWGNC, and BSC follows again by 
applying Theorem [ 



°In the latter case the partial design is even a BIBD with parameters 

(4=+2= + l,2'' + l,l). 



We remark that the bounds of Propositions 17.71 and 17.81 are 
sharp at least for the case to = 3 and the max-fractional 
weight, see Section [VlII-BI 

The following proposition proves that the AWGNC, BSC, 
and max-fractional pseudocodeword redundancies are finite for 
all codes C with minimum distance at most 3. 

Proposition 7.9: Let C be a [n, k, d] code with d < 3. Then 
/3max rrac(C) is finitc. Morcovcr, we have /9mi,x-rnic(C) ~ n — k in 
the case d < 2. 

Proof: By using Lemma 14.21 we may assume d = 3. 
Denote by H the parity-check matrix whose rows consist of 
all codewords of the dual code of C. Note that for a code of 
minimum distance d, a parity-check matrix H consisting of 
all rows of the dual code is an orthogonal array of strength 
d — 1. In the present case d = 3, and this implies that in any 
pair of columns of H, all length-2 binary vectors occur with 
equal multiplicities (cf. fT9, p. 139]). Thus the matrix H is 
an incidence matrix for a partial block design with parameters 
{wc, A) = (2''^^, 2''^^), where r — n — k. Therefore for this 
matrix H the code has minimum (AWGNC, BSC, or max- 
fractional) pseudoweight at least 1 + Wc/X — 3, and it follows 
that the pseudocodeword redundancy is finite for any code 
with d = 3. ■ 

We remark that Proposition 17.91 implies the results for the 
Hamming codes (Proposition I7.7l l. However, we present the 
two proofs, since they use different methods. 

We have considered in this section several families of 
codes based on designs, which have finite pseudocodeword 
redundancy. As noted in Section III-EI finiteness of pseu- 
doredundancy would also follow if one can show that the 
codes are geometrically perfect. However, this is not the 
case for the examined codes in general. For example, the 
[2™ — 1 , 2™ — 1 — TO , 3] Hamming code is not geometrically 
perfect for m > 4; this follows from the characterization of 
geometrically perfect codes, as the [7,3,4] simplex code can 
be obtained from the Hamming code by repeated shortening, 
when TO > 4. 

VIII. The Pseudocodeword Redundancy for Codes 
OF Small Length 

In this section we compute the AWGNC, BSC, and max- 
fractional pseudocodeword redundancies for all codes of small 
length. By Lemma 14.21 it is sufficient to examine only codes 
with minimum distance at least 3. Furthermore, in light of 
Lemma 14.11 we will consider only codes without zero coor- 
dinates, i.e., codes that have a dual minimum distance of at 
least 2. Finally, we point out to Corollary 16.41 for codes of 
dimension 2, by which we may focus on codes with dimension 
at least 3. 

A. The Algorithm 

To compute the pseudocodeword redundancy of a code C 
we have to examine all possible parity-check matrices for the 
code C, up to equivalence. Here, we say that two parity-check 
matrices H and H' for the code C are equivalent if H can 
be transformed into H' by a sequence of row and column 
permutations. In this case, Wi„in(i?) = Wmin(-H'') holds for 
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TABLE I 

The Number of Binary [n, k, d] Codes 

WITH d > 3 AND WITHOUT ZERO COORDINATES 





fc = 1 


2 


3 


4 


5 


n = 5 


1 


1 








6 


1 


3 


1 






7 


1 


4 


4 


1 




8 


1 


6 


10 


5 




9 


1 


8 


23 


23 


5 



the BEC, AWGNC, BSC, and max-fractional pseudoweights. 
The enumeration of codes and parity-check matrices can be 
described by the following algorithm. 

Algorithm 8.1: 

Input: Parameters n (code length), k (code dimension), 
p (number of rows of the output parity-check matrices), where 
p > r = n — k. 

Output: For all codes of length n, dimension k, minimum 
distance d > 3, and without zero coordinates, up to code 
equivalence: a list of all p x n parity-check matrices, up to 
parity-check matrix equivalence. 

1) Collect the set X of all r x n matrices such that 

• they have different nonzero columns, ordered lexi- 
cographically, 

• there is no non-empty F2-sum of rows which has 
weight or 1 (this way, the matrices are of full 
rank and the minimum distance of the row space is at 
least 2). 

2) Determine the orbits in X under the action of the 
group GLr(2) of invertible r x r matrices over F2 (this 
enumerates all codes with the required properties, up to 
equivalence; the codes are represented by parity-check 
matrices). 

3) For each orbit Xc, representing a code C: 

a) Determine the suborbits in Xc under the action 
of the symmetric group Sr (this enumerates all 
parity-check matrices without redundant rows, up 
to equivalence). 

b) For each representative H of the suborbits, collect 
all matrices enlarged by adding p — r different 
redundant rows that are F2-sums of at least two 
rows of H . Let Xc,p be the union of all such pxn 
matrices. 

c) Determine the orbits in Xc.p under the action of the 
symmetric group Sp, and output a representative 
for each orbit. 

This algorithm was implemented in the C programming 
language. The minimum pseudoweights for the various parity- 
check matrices were computed by using Maple 12 and the 
Convex package 1241 . 

B. Results 

We considered all binary linear codes up to length n with 
minimum distance d > 3 and without zero coordinates, up 
to code equivalence. The number of those codes for given 
length n and dimension k is shown in Table |I] 



1) AWGNC pseudoweight: The following results were 
found to hold for all codes of length n < 9. 

> There are only two codes C with Pawgnc(C) > r, i.e., in 
class or 1 for the AWGNC. 
- The [8, 4, 4] extended Hamming code is the shortest 
code C in class 1. We have /Oawgnc(C) — b > A — r 
and out of 12 possible parity-check matrices (up to 
equivalence) with one redundant row there is exactly 
'{H) — 4, namely 



one matrix H with 



H 



10011001 
01010101 
00110011 
11110000 
00001111 



There is exactly one matrix H with w**™'^(J?) = 
25/7, and for the remaining matrices H we have 



For this code. 



also Pbec(C) = 5 > 4, and it is the 
only code of length n < 9 with Pbec{C) > r. 
- Out of the four [9, 4, 4] codes there is one code C 
in class 1 . We have Pawgnc 

(C) = 6 > 5 = r and 
out of 2526 possible parity-check matrices (up to 
equivalence) with one redundant row there are 13 
matrices H with w™™^ (ff) = 4. 

For all codes C of minimum distance d > 3 and for all 
parity-check matrices of C we have w™™'^{H) > 3; in 
particular, if d = 3, then C is in class 3 for the AWGNC. 

For the [7, 3, 4] simplex code there is (up to equivalence) 
only one parity-check matrix H without redundant rows 
(H) = 4, namely 



such that w™™^ 



H 



110 10 
110 10 
110 10 
1 1 1 



It is the only parity-check matrix with constant row 
weight 3. 

2) BSC pseudoweight: We computed the pseudocodeword 
redundancy for the BSC for all codes of length n < 8. 

« The shortest codes with Pbsc(C) > r, i.e., in class or 1 
for the BSC, are the [7, 4, 3] Hamming code C and its dual 
code C^, the [7,3,4] simplex code. We have Pbsc(C) = 
4 > 3 and Pbsc(C^) = 5 > 4. 

• There are two codes of length 8 with /Obsc(C) > r. 
These are the [8, 4, 4] extended Hamming code, for which 
pBsc(C) = 6 > 4 holds, and one of the three [8,3,4] 
codes, which satisfies Pbsc(C) = 6 > 5. 

3) Max-fractional weight: We computed the pseudocode- 
word redundancy with respect to the max-fractional weight 
for all codes of length n < 8. 

• The shortest code with p„„„-rnic(C) > r is the unique 
[6, 3, 3] code C. We have p„,„_r„,c(C) 4 > 3. 

• There are two codes of length 7 with p„„„_fc,c(C) > r. These 
are the [7,4,3] Hamming code and the [7,3,4] simplex 
code, which have both pseudocodeword redundancy 7. In 
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both cases, there is, up to equivalence, a unique parity- 
check matrix H with seven rows that satisfies d{C) — 

^min (-")■ 



This demonstrates that Propositions 17 .7 1 and 17 . 8 1 are sharp 
for the max-fractional weight, and that the parity-check 
matrices constructed in the proofs are unique in this case. 

• For the [8,4,4] extended Hamming code C we have 
/3max-frac(C) — oo, and thus the code is in class for the 
max-fractional weight. It is the shortest code with infinite 
max-fractional pseudoredundancy. 

(It can be checked that x = [1,1,1,1,1,1,1,3] is a 
pseudocodeword in JC{H), where the rows of H consist 
of all dual codewords; since w„„_f„c(a;) = ^ < 4, we 
have w7i^'"'(jy) < 4.) 

• There are two other codes of length 8 with /0„,„ irai (C) > r, 
namely two of the three [8,3,4] codes, having pseu- 
docodeword redundancy 6 and 8, respectively. 

4) Comparison: Comparing the results for the AWGNC 
and BSC pseudoweights, and the max-fractional weight, we 
can summarize the results as follows. 

• For the [7,4,3] Hamming code C we have /Oawgnc(C) = 
r = 3, Pbsc(C) = 4, and p„,-„(C) = 7. 

• For the [7,3,4] simplex code C we have Pawgnc(C) = 
r = 4, Pbsc(C) = 5, and p„,„(C) = 7. 

• For the [8,4,4] extended Hamming code C we have 

Pawgnc(C) = 5, Pbsc(C) = 6, and p„„-rr.c(C) = oo. This 
code C is the shortest one such that Pawgnc (C) > r, and 
also the shortest one such that p„,„_i„(C) = oo. 

• If d > 3 then for every parity-check matrix H we have 
wX'''^(i?) > 3. This is not true for the BSC and the 
max-fractional weight. 

These observations show that there is some significant 
difference between the various types of pseudocodeword re- 
dundancies. 

It is also interesting to note that the [7, 4, 3] Hamming code 
is geometrically perfect, while the [7, 3, 4] code and the [8, 4, 4] 
code are not (cf. Section Hl-Eb . 

IX. Cyclic Codes Meeting the Eigenvalue Bound 

In this last section we apply the eigenvalue-based lower 
bound on the minimum AWGNC pseudoweight by Vontobel 
and Koetter |9|, see Proposition [73] We investigate for which 
cyclic codes of short length this bound is sharp with respect 
to the minimum Hamming distance, for in this case, the codes 
have finite AWGNC pseudoredundancy. 

We consider binary cyclic codes with full circulant parity- 
check matrices, defined as follows: Let C be a binary cyclic 
code of length n with check polynomial h{x) = X^iei ^i^* 
(cf. II19II . p. 194). Then the full circulant parity-check matrix 
for C is the n x n matrix H = {Hj^i)i,j^i with entries 
Hj^i — hj^i. Here, all the indices are modulo n, so that 
I={0,l,...,n-1}. 

Since such a matrix is w-regular, where w = J^iei 
may use the eigenvalue-based lower bound of Proposition 17.51 
to examine the AWGNC pseudocodeword redundancy: If the 



right hand side equals the minimum distance d of the code C, 
then /9awgnc(C) < n. 

Note that the largest eigenvalue of the matrix L = H is 



~ w , since every row weight of L equals ^ • ^g^; hihj 
Consequently, the eigenvalue bound is 



w 



> n ■ 



2w 



lJ-2 



where /i2 is the second largest eigenvalue of L. We remark 
further that L — {Lj,i)i,j^x is a symmetric circulant matrix, 
with Lj^i = ij^i and £i = 'Y^^.^j-hkhk+i- The eigenvalues of 
L are thus given by 



A, 



^ l^Ci = Re ^ = E cos(27rzj7r 



for i £ X, where C„ ~ exp(27ri/n) is the n-th primitive root 
of unity and = — 1 (see, e.g., 1,25,1 . Theorem 3.2.2). 

We also consider quasi-cyclic codes of the form given in the 
following remark. This code construction is only introduced 
for completeness towards classifying the results; the resulting 
codes are not interesting for applications, as the minimum 
Hamming distance is at most 2 for m > 2. 

Remark 9.1: Denote by 1,„ the m x m matrix with all 
entries equal to 1. If i? is a w-regular circulant nx n matrix 
then the Kronecker product H ^ H ^l„i will be a w-regular 
circulant mn x mn-matrix and defines a quasi-cyclic code. We 
have 

L = H^H = H^H ® 1^1™ = L® (ml„) , 

and the eigenvalues of ml„i are m? and 0. Thus, the largest 
eigenvalues of L are jli = m^/ii = m'^w'^ and fl2 = m^P2, 
and the eigenvalue bound of Proposition 17.51 becomes 

2mw — m? ^,2 



AWGNC ^ ™,„ 



rrflw^ — rn?^2 



2w — rn/i2 
- p2 



We carried out an exhaustive search on all cyclic codes C up 
to length n < 250 and computed the eigenvalue bound in all 
cases where the Tanner graph of the full circulant parity-check 
matrix is connected, by using the following algorithm. 

Algorithm 9.2: 

Input: Parameter n (code length). 

Output: For all divisors of a;" — 1, corresponding to cyclic 
codes C with full circulant parity-check matrix, such that the 
Tanner graph is connected: the value of the eigenvalue bound. 

1) Factor a;" — 1 over F2 into irreducibles, using Cantor 
and Zassenhaus' algorithm (cf. I.26J . Section 14.3). 

2) For each divisor /(x) of a;" — 1: 

a) Let f{x) = Y.i ^i^^ H = (/ij-j)jjei. 

b) Check that the corresponding Tanner graph is con- 
nected (i.e., that the greatest common divisor of 
the indices i with hi = 1 together with n is 1). 

c) Compute the eigenvalues of i = H^H: Let 

~ 12kei ^khk+i and for j <E I compute 
Y,i cos{2nij/n). 

d) Determine the second largest eigenvalue p2 and 
output n ■ (24 - Ai2)/(^o - /^2)- 
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TABLE 11 

Binary Cyclic Codes up to Length 250 with i 
Meeting the Eigenvalue Bound 



Finally, we apply Proposition 17.51 to get 



parameters 



ui-regulai' constituent code 



[2n,2n-m, 2] 2™ Hamming c, n = 2™ - 1, m = 2 . . . 6 

[2n, 2n — m — 1, 2] 2™— 2 Hamming c. witli overall parity-clieck 
[42, 32, 2] 10 projective geometiy code PG{2, 4) 

[146, 118, 2] 18 projective geometry code PG(2, 8) 

[170, 153, 2] 42 a certain [85, 68, 6] 21-regular code 

(the eigenvalue bound is 5.2) 

TABLE III 

Binary Cyclic Codes up to Length 250 with d> 3 
Meeting the Eigenvalue Bound 

parameters ui-regular comments 



[n, 1, n] 
[n, n — m, 3] 
[7, 3, 4] 
[15,7,5] 
[21, 11,6] 
[63, 37, 9] 
[73,45, 10] 



2 

3 
4 
5 



repetition code, n = 3 . . . 250 
Hamming c, n = 2™ — 1, m = 3 . . 
dual of the [7, 4, 3] Hamming code 
Euclidean geometry code EG(2,4) 
projective geometry code PG(2,4) 
Euclidean geometry code EG(2,8) 
projective geometry code PG(2,8) 



This algorithm was implemented in the C programming 
language. Tables and give a complete list of all cases 
in which the eigenvalue bound equals the minimum Hamming 
distance d, for the cases d — 2 and d > 3, respectively. In 
particular, the AWGNC pseudoweight equals the minimum 
Hamming distance in these cases and thus we have for the 
pseudocodeword redundancy Pawgnc(C) < n. All examples 
of minimum distance 2 are actually quasi-cyclic codes as in 
Remark |9T| with parity-check matrix H = H ® '^2- We list 
here the constituent code given by the parity-check matrix H. 

We conclude this section by proving a result which was 
observed by the experiments. 

Lemma 9.3: Let m > 3 and let C be the intersection of a 
Hamming code of length n = 2™ — 1 with a simple parity- 
check code of length n, which is a cyclic [n ,n — m — 1,4] 
code. Consider its full circulant parity-check matrix H. Then 

w-r(ff)>3 + ^;^^>3. 

In particular, if m = 3 then C is the [7,3,4] code and the 
result implies w^-Jf (JJ) = 4 and Pawgnc(C) < 7. 

Proof: Let H be the w-regular full circulant parity-check 
matrix for C. We claim that w — 2™~^ — 1. Indeed, each 
row ft. of is a codeword of the dual code C^, and since 
C"*- consists of the codewords of the simplex code and their 
complements, the weight of h and thus w must be 2™^^ — 1, 
1^ or 2™ — 1. But w cannot be even, for otherwise all 
codewords of would be of even weight. As w — 2™ — 1 is 
clearly impossible, it must hold w = 2™^^ — 1. 

Next, we show that the second largest eigenvalue of L = 
H — {Lj^i)ij^x equals /i2 = 2™~^. Indeed, let hi and 
/i2 be different rows of H, representing codewords of C^. 
As their weight is equal, their Hamming distance is even, and 
thus it must be 2™^^. Hence, the size of the intersection of the 
supports of hi and h2 is 2™^^— 1. This implies that Li,i ~ w 
and Lj i = 2™^^ — 1, for i ^ j. Consequently, L has an 
eigenvalue of multiplicity n — 1, namely w — (2™^^ — !) = 
2™-^ and thus fi2 must be 2"'-^. 



w 



> (2™-l) 



2(2" 



(2"-!) (2 (2"-i-l) - 2™-2) 
(2"-l) (2"-2-l) 



which proves the result. 
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